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Conventions 


Before working through this correspondence text make sure you have read 
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N for Linear Algebra and Matrix Theory 


All starred items in the summaries are examinable. 


References to the Open University Mathematics Foundation Course Units 
(The Open University Press, 1971) take the form Unit M100 3, Operations 
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5.0 INTRODUCTION 


In this unit we look at linear transformations whose domain and codomain 
are the same vector space; such linear transformations we call endomor- 
phisms. We shall be looking for properties that are “ geometrical ” (i.e. 
intrinsic) in character, in the sense that they do not depend on the basis 
used in representing the transformation as a matrix. We have already seen 
some “ geometrical” properties of this kind—in particular, the dimension 
of the domain vector space of the transformation and the rank (the dimen- 
sion of the image space) of the transformation. 


We shall consider first a number which measures the factor by which n- 
dimensional “volumes” in a real vector space are changed by a linear 
transformation. This factor is called the determinant of the trans- 
formation; the immediate use we shall be making of it is to give a 
convenient theoretical criterion for identifying singular transformations 
(transformations which do not have inverses). It turns out that such trans- 
formations are characterized by having determinant zero. The reason is 
that a singular transformation maps its domain on to a subspace of lower ` 
dimension; the effect of such a transformation with a two-dimensional 
domain is to convert a plane figure into a line, so reducing the “ volume " 
(area) of the plane figure to zero. 


domain codomain 


o(x;) 


squashed 
parallelogram 
(area = 0) 


parallelogram 
(area > 0) 


c is a singular transformation 


The second type of number we shall consider measures the effect of a linear 
transformation on lengths, rather than volumes. Although the idea of 
length is not part of the definition of a vector space, it is possible to com- 
pare the lengths of two vectors provided the vectors are scalar multiples of 
one another. Geometrically, this means that the two vectors must be ' paral- 
lel.” Thus if the linear transformation L maps a particular vector x to a 
vector Ax, where À is a scalar, then we may say that it has changed the 
“length” of this vector by a factor 2. The special vectors that have this 
property are called eigenvectors of L and the corresponding scalar multi- 
pliers are called eigenvalues of L. The one-dimensional subspace spanned 
by an eigenvector is invariant under L; i.e. it maps to itself. It is very often 
the case in mathematics that transformations are best studied by observing 
and making use of entities which they leave unchanged: that proves to be 
the case here, as we shall see. 


One of the main applications of eigenvalues and eigenvectors is in the 
theory of vibrating mechanical or electrical systems, such as the aircraft 
vibrations considered in the radio programme of Unit M100 31, Differential 
Equations II. We shall be studying this type of application later in the 
course. 


Another application arises in quantum physics; for example, the reason 
for the ghastly yellow colour produced by sodium-vapour street lamps is 


that sodium emits visible light of only one frequency. The theory of this 
kind of light emission relates the possible frequencies of emitted light to 
the possible values for the energy of a sodium atom, which are given by 
the eigenvalues of a certain linear operator. (This course does not, however, 
require any knowledge of quantum mechanics.) There are many other 
applications, some of which you will meet later in the course. 


In this unit we shall be looking mainly at the theory, rather than the ap- 
plications of eigenvalues. We shall introduce the determinant to provide a 
criterion for singular transformations; this leads to a simple method for 
finding the eigenvalues and eigenvectors in spaces of dimension 2 or 3. In 
later units we shall find many applications for eigenvalues and eigenvectors, 
and shall look at effective methods for calculating them in spaces of many 
dimensions. 


5.1 THE DETERMINANT—AN INTRINSIC 
PROPERTY OF ENDOMORPHISMS 


5.1.0 Introduction 


In this section of the unit we shall define, for any endomorphism of an 
n-dimensional vector space, a scalar called the determinant of that 
endomorphism. It can be interpreted as the factor by which the endo- 
morphism magnifies n-dimensional “volumes”. We shall approach the 
definition by considering endomorphisms of a plane into itself, for which 
case these “‘ volumes” are really areas, and look for properties of the magni- 
fication factor that can be generalized to n-dimensional vector spaces. 
These properties are then formalized as a set of axioms which are the basis 
of the definition of determinants. We then obtain an algorithm for 
evaluating determinants, which makes use of what you already know 
about Hermite normal form. 


5.1.1 The Magnification of Areas 


The two-dimensional example we shall consider is the vector space R?, 
where elements can be represented in the usual way by points in a plane. 
We saw in Unit 2, Linear Transformations (Theorem 1.17, page N34) that 
any linear transformation is completely specified by its effect on a fixed 
basis, and so any endomorphism of the plane can be specified by giving the 
image vectors of some fixed basis of R?. We shall take as fixed basis, the 
standard basis 


{(1, 0), (0, 1). 


To conform with the notation of K we shall denote this basis by fe; , e2}, 
and its image by (a, , a;). 


e= (0,1) c 


= > a 


az 


e,=(1,0) 


To calculate the magnification produced by the endomorphism c, we 
compare the area of a geometrical figure in R? with the area of its image. 


A convenient figure to consider is the square shown in the diagram. The 
image of this square under c is the parallelogram shown. 


(0,1) azs 


(1,0) 


If we take the square to be of unit area, then the area of the parallelogram 
is equal to the magnification produced by the linear transformation. It 
is not too difficult to obtain a formula for the area of the parallelogram 
in terms of the coordinates of a, and a;, but the generalization of this 
formula to n dimensions is not obvious. In keeping with our philosophy 
of looking for basis-independent properties, we can approach the problem 
from the point of view of vectors rather than coordinates. 


We are interested in the function 
D:(a,,a5) '——— area of parallelogram (a; , a, e R?). 


(We use the letter D because we are using this area as our definition of 
determinant for endomorphisms of R?. There should be no confusion with 
the use of the letter D for the differentiation operator.) 


Since the domain of the function D is a set of pairs of vectors, we begin by 
simplifying and keep one of the vectors fixed and see how the area depends 
on the other; in other words, we study the function 


fia, => D(a,, a2) (a; e R°) 
for some fixed vector a, . Let us investigate whether this function is a linear 


transformation. 


To test whether the function f preserves scalar multiplication, we compare 
two parallelograms on the same base a, with neighbouring sides a; and 
aa, respectively, where a is a scalar. 

C. 


] 
aa, B 


ay 


From elementry geometry we know that the parallelogram AB'C'O has 
area x times that of ABCO, so that we have 


(a7) = of (a). 


To test whether f is a morphism for addition, we can put together two 
parallelograms on the same base as shown below: 


Since the two shaded areas are equal, the two parallelograms with black 
sides have the same total area as the parallelogram with red sides; that is, 


f(a;) + f (a7) =flaz + a4). 
Thus we have shown that fis a linear transformation. In the same way we 
can show that the function 


a, ——> D(a,, a5) (a, € R2), 


where a, is any fixed vector in R?, is a linear transformation. Thus 
D(a, , 42) is linear in a, for fixed a, , and in a, for fixed a, . (Such a function 
is said to be bilinear; we shall study bilinear functions in more detail later 
in the course.) 


There are two more properties of the area magnification function which 
are geometrically obvious. First, if a, = a5, then the parallelogram col- 
lapses and has zero area: 


D(a,,a,)=0 (a, eR?) 


Secondly, if a, and a, are the same as our original basis vectors e, and e;, 
then our transformation must be the identity transformation, which leaves 
areas unchanged, and therefore 


Dey, e) = 1. 


It is possible to show that there is precisely one function D with the three 
properties we have discussed, viz: 


(i) Dis bilinear 
Gi) D(ay, a) = 0 (a, €R?) 
(iii) D(e,, e) = 1 


(The proof is given in a reading passage which we shall refer to shortly.) 
This function is specified by 


D(a, , a2) = 41,455 — d12021 


where a,, and a;, are the coordinates of a, , and a,, and a,, are the co- 
ordinates of a, with respect to the basis {e, , e2}. Note that D is a transfor- 
mation from R? to R. 


Since a, and a; are the images of e, and e; under the endomorphism c, we 
can represent a, relative to (e, , ej), by the matrix 


ay aa) 
451 222. 


LM 5.1.1 


This is because the coordinates of the images of the two basis vectors in 
the domain form the two columns of the matrix of c (see sub-section 2.2.1 
of Unit 2, Linear Transformations). 


CS (as, 21) 


(0,1) (212,822) 


(1,0) 


Exercise 


From geometrical considerations, what would you expect the determinants 
of the following endomorphisms of R? to be? 


(i) A rotation through the angle 0 radians about the origin. 
(ii) A magnification of all linear dimensions by 2. 
(iii) A reflection in the y-axis. 


Obtain the matrices of these transformations (by considering the images of 
the basis vectors, as in Unit 2, Linear Transformations), calculate their 
determinants from the formula given above, and so check your geometrical 
intuition. 


Solution 


cos@ —sin 0 
sin 0 cos 0 
Transformations. Its determinant is cos? 0 + sin? 0 = 1, con- 
firming that rotations do not alter areas. 


(i) The matrix is [ | as given in Unit 2, Linear 


(i) The matrix is F ; . and its determinant is 4 (not 2): 


doubling the linear dimensions quadruples the area. 


(iii) The matrix is E i and its determinant is ~1, not +1 


as you may have expected. Although the transformation 
leaves the areas of figures unaltered, it does “turn them 
Over", just as a mirror interchanges right and left. This is 
the significance of the negative sign. 


5.1.2 Defining the Determinant Function 


In this sub-section we see how to generalize the idea of determinant to endo- 
morphisms in the vector space A". The method is to generalize the three 
properties we found in sub-section 5.1.1 for area magnification factors 


in R?, and use these three as axioms for a definition of determinants in 
general. 


READ Section III-1 on pages K680-681. 


Notes 


(i) lines 6 to 7, page K680 Strictly speaking, D (not D(ai,...,a,)) is the 
function; its codomain is Z (this is the significance of “ real-valued”) and its 
domain is the set of all »-tuples of vectors from 2”. Although the discussion in 
K is in terms of real vector spaces, the corresponding theory for vector spaces’ 
over an arbitrary field (with D: F^ x ... x F" ———» F) is analogous. 

(i) line 8, page K680 This is a generalization of the condition D(a, , ai) =0 we 
found in the preceding section; it makes the determinant function a useful theo- 
retical criterion for linear independence of vectors. 

(iii) Definition III-1, page K680 The three conditions in this definition are 
generalizations of the three properties of D(a, , a2) we found previously for gn. 
Note that we have not yet shown whether a function satisfying these conditions 
exists, nor whether it is unique if it does exist, nor how to calculate it if it does 
exist and is unique. 

(iv) line 10, page K681 “Since the function D..." In effect, this paragraph 
defines a new function, whose domain is the set of all n x » square matrices with 
real entries, whereas the domain of D is the set of all »-tuples of vectors in p. 


The relation between the functions det and D is indicated by the following 
example: 


12 
det [; A = D((1, 3), (2, 4) 


The image of a matrix M under the function det is called the determinant of M. 
Note that we have only defined the determinant of a matrix M with real entries. 


Exercises 
100 100 
1. Evaluate}O 2 Oj,ie.det|0 2 0 
003 003 


with the help of Conditions | and III in Definition IIJ-1. 


2. Use the preceding result, and Conditions I and Il, to evaluate 


104 
020 
003 
3. Use Conditions J, I] and III to evaluate 
abc 
0d f 
008g 


where all the letters stand for real numbers. 


Solutions 


l. By the definitions of det and of the standard basis vectors in 
R3, we have 


100 
det |0 2 0| = D(e,, 2e;, 3e) 
003 


= 2D(e, , e; , 3e3) (Condition 1) 
= 6D(e,, e;, e) (Condition I) 


-6 (Condition III). 
2. [104 
0 2 0} D(e,, 2e;, 4e, + 3e;) 
003 
= D(e, , 2e; , 4e,) + D(e, , 2e; , 3e;) 
(Condition I) 
= 4D(e, , 2e; , ej) + D(e; , 2e; , 3e3) 
=0 + D(e,, 2e; , 3e) 
(Condition II) 
=0+6 
(Solution 1) 
- 6. 
3. la be 
0 d f| = DX(ae, , be, + dez, ce, + fe; + ge3) 
00g 


7 a D(e, , be, + dez, ce, + fe; + ges) 
(Condition I) 
7 a[bJXe, , e, , ce, + fe; + ges) 
* d D(e, , e; , ce, + fe, + gey)] 
(Condition 1) 
= adD(e, , èz, ce, + fe; + ges) 
(Condition 11) 
= ad [cD(e, , e; , e) + f/D(e, , e; , e;) 


+ gD(e,, ez, e3)] (Condition I) 
= adg D(e, , ez, ey) (Condition 11) 
= adg (Condition 111). 


Thus the determinant of an upper triangular matrix (one 
having only zeros below its main diagonal from top left to 
bottom right) equals the product of the diagonal elements, 
The same result holds for lower triangular matrices. 


5.1.3 Column Operations 


The definition we have adopted for the determinant function leaves several 
questions unanswered. Does such a function exist? If so, is it unique? 
If it does exist, how do we calculate images under the function? The first 
two questions are answered in Theorem III-3 on page K684; we shall ask 
you to read this theorem and its proof, but we shall not expect you to re- 
produce it; all you need for this course is the fact that the determinant 
function does exist, some idea of its form, and that it is unique. The third 
question, on the other hand, is much more important: in order to be able 
to use determinants, we shall need to be able to evaluate them. 


The basis of the practical method for evaluating determinants is the same as 
that of the method you studied in Unit 3, Hermite Normal Form for calcu- 
lating inverses of matrices; it is the fact that any non-singular matrix can be 
expressed as a product of elementary matrices. Since a determinant repre- 
sents the magnification produced by a linear transformation, we would 
expect the determinant of such a product of elementary matrices, repre- 
senting the magnification produced by successive performance of several 
linear transformations, to equal the product of their separate magnifica- 
tions. We shall show that this expectation is justified: the determinant of 
a product of matrices does equal the product of their determinants; and in 
doing so, we shall develop a method for evaluating determinants. 


We first consider the effect of multiplying a matrix by one of the elemen- 
tary matrices discussed in Unit 3, Hermite Normal Form. If we put an 
elementary matrix on the left of a given matrix and then multiply the 
matrices, the effect is the same as that of a row operation; but since we 
have defined determinants in terms of their columns, we want column 
operations rather than row operations. This can be achieved by placing 
the elementary matrices on the right, and then multiplying. 


We illustrate this by examples (the classification of column operations and 
of elementary matrices is taken from pages N57 and N58). In each of the 
three cases, we suggest that you carry out the indicated matrix multiplica- 
tion and fill in the entries in the blank matrix, to verify that the multiplica- 
tion does have the same effect as the stated column operation. 


Type I column operation (multiply a column by a scalar) 


pPqrifl 00 
u v w||0 1 0| = 
x yp zJi00 c 


This result is true whether or not c = 0, but the second matrix factor is 
called an elementary matrix only if c # 0. 


Type II column operation (add a multiple of one column to another column) 


pqrifi oo 
u v wif0 1 0} = 
x p zjlc 01 


Type III column operation (interchange two columns) 


Pp q r][0 1 O 
u v wj|l 0 0j= 
x y zj|0 0 I 


The effects of these three types of column operation on the determinant 
of the matrix can be found from the definition of a determinant. For ex- 
ample, in the case of a Type I operation, Condition I in the definition of a 
determinant tells us that D(a,,..., a„) is linear in each of its n variables 
(the columns of the matrix), and so if one of these columns is multiplied by 


c, then so is the determinant. The corresponding results for operations of 
Types Il and III are contained in the next reading passage. 


READ Section TIT-2, pages K682-687 but note that there are sections of 
this reading passage which are not required in any detail. These sections 
are indicated in the notes below. 


Notes 


(i) Theorem III-1, page K682 This can be thought of as a special case of the 
rule we have just derived for Type I column operations, in which we take c = 0. 
(ii) line 7 and footnote, page K682 Be careful to distinguish between a function 
and its image. In the footnote a permutation is a one-one function, whereas 
in the text, the permutation is the image of a one-one function. In fact, the 
function p has been applied to the subscripts of the vectors ei, ..., e, and the 
resulting rearrangement of the vectors is called a permutation. 

(iii) lines 2-4, page K683 If you have the time, you might like to prove this 
missing result. Probably the easiest way to do it is by contradiction. (Hint: if you 
perform a sequence of interchanges on (1, ..., n} and the result is again (1, .. . , n}, 
can the number of interchanges be odd?) 

(iv) lie 11, page K683 The details of the rest of the argument leading to 
Theorem II1-3 are not important, although well worth studying if you have the 
time. The method has been used a number of times already; the only really new 
thing is its generality. 

(v) Theorem III-3 page K684 The form of the result is important, as is the 
observation in the paragraph which follows. The remainder of pages K684-6 to 
the end of the proof of Theorem III-4 are not important, although it would be 
advisable to read them through, ignoring the technical details. We give an alter- 
native proof of Theorem III-4 in sub-section 5.1.5. 

(vi) The remainder of Section III-2 beginning at “The last theorem..." on 
page K686 should be studied properly. (In spite of lines 4-6 on page K687, we 
shall not be studying the next section in K, but we do obtain the result in the next 
section of the correspondence text.) 


We can summarize the effects of column operations by the following rules: 


I Multiplying any column by a scalar multiplies the determinant by that 
scalar. 


JI Adding a multiple of any column to any other column leaves the 
determinant unaffected. 


III Interchanging any two columns reverses the sign of the determinant. 


We can interpret these three rules geometrically in the case of endo- 
morphisms of the plane, which we considered in sub-section 5.1.1. 


I 


^a; 


If we multiply one side of a parallelogram by a factor, 2, then the area is 
multiplied by the same factor, 4. Here the columns of the determinant are 
represented by vectors a, and a;. 


Since the shaded areas are 
equal, the parallelograms 
formed by a,,a; and aj, 
Àa; + ap have the same area 


This corresponds to the elementary geometrical result that parallelograms 
on the same base and with equal heights have equal areas. 


In 


We can interchange a, and a; by reflecting in the line bisecting the angle 
between them. The result is to turn the parallelogram over (rotation of 7), 
which accounts for the change of sign, as we have scen previously. 


Using these rules we can evaluate any determinant. The following three 
examples show how. 


Example 1 
la il -| = : col.1 —2 x col. 2 (Rule II) 
- | 7 i col.2 +3 col. 1 (Rule IT) 
jai | 1 O| using Rule I to remove the 
0 1] factor —2 from col. 1 
2-2, 


since D(e; , e2) = 1, by Condition III of the definition of the determinant 
function (page K680). 


The above calculation could have been shortened if we had used the fact 
noted in Solution 3 of sub-section 5.1.2, that the determinant of an 
upper triangular matrix equals the product of its diagonal clements. This 
fact would have told us after the very first column operation that the de- 
terminant is —2. The standard method for evaluating determinants 
makes use of this fact. 


LM 5.1.3 


Example 2 
L 2-9 | 2 —2] col. 3 — col. 2 (the 1 at the bottom 
3 4 5|=|3 4 1| right simplifies the clearing of the 
6 7 8 6 7 I| bottom row) 
13 2 -2 
=/-3 4 1| col. 1 — 6 x col. 3 
0 7 I 
13 16 —-2| col.2—7 x col. 3 
2-3 -3 1| (bottom row is now 
0 0 1| clear) 
E S k = col. 1 — col. 2 
E 0 0 1 (upper triangular) 
=(-3) x (-3)x 1 =9. 
Example 3 
010 100 100 
00 1[2—-|0 0 lj=|0 I O|«l. 
100 010 001 


(Two applications of Rule III: each column interchange reverses the sign.) 


Exercises 


Evaluate the following determinants by using column operations (if neces- 
sary) to reduce them to triangular form. 


1. The determinant of the Type I elementary matrix: 


100000 
010000 
00c000 
000100 
000010 
000001! 


2. The determinant of the Type II elementary matrix: 


000 


oOnoco- 
o 
1050 oO oO 


1 
0 
001 
0 


3. The determinant of the Type III elementary matrix: 


0001 
0100 
0010 
1000 

4. (i) 1 3 0 qi) Jl 0 -1 (iii) |1 2 3 

0 12 31 -2 456 

-1 -2 1 02 1 100 


For Exercises 1, 2 and 3, compare your results with the factor by which the 
corresponding elementary operation multiplies the determinant of an 
arbitrary matrix, as given in Rules I, H and III above. D 


) O you see any 
connection between Exercises 4(i) and A(ii)? 


LM 5.1.3 


LM 5.1.3 


Solutions 


l. Determinant = c. It is already triangular. 


2. Determinant = 1. It is already triangular. 


3. Determinant = —1 (interchange cols. 1 and 4). 
In each case the determinant of the elementary matrix equals 
the corresponding factor given in Rules I, II, and III. 
4. (i) Determinant = —1. Here is one of many methods: 
1 3 0 
0 1 2 
-1-2 I 
1 3 0 1 3 0 —4 3 0 
=/2 1 2/=/2 5 22/0 5 2|--I1 
0-2 1! 0 0 1 0. 0 1 
(col. 1 (col. 2 (col. 1 
+ col. 3) +2xcol.3)  —£x col. 2) 


(ii) Determinant = —1. 


The matrix whose determinant we evaluated in this 
exercise is the transpose of the one in Exercise 4 (i), and 
their determinants are equal. 


(ii) Determinant = —3. One method is 
1 2 3 1 2 1 1.0 | 
4 5 6/=3/4 5 2|-23|4 1 2 
1 0 0 1 0 0 1 0 0 
(take 3 (col. 2 —2 
as x col. 3) 
common 
factor 
from 
col. 3) 
1 0 1 1 0 1 
=-3/2 1] 4!/=-31/0 | 4|-2-3. 
0 0 1 0 0 | 
(interchange (col. 1 — 2 
cols. 1 and 3) x col. 2) 


5.1.4 Determinants and Matrix Multiplication 


In the previous sub-section we saw how an elementary column operation 
multiplies the value of a determinant by a factor which depends only on 
the elementary operation (for example, interchanging two columns multi- 
plies the determinant by the factor — 1, regardless of the entries in the 
interchanged columns). Since any column operation is equivalent to 
multiplication on the right by some elementary matrix E, we can write this 


det (AE) = det (A) x k (1) 
where & depends only on E. 


We also saw (in Solutions I, 2 and 3 of the previous sub-section) that for 
each typical elementary matrix the factor k is equal to the determinant 
of the elementary matrix. To see that this is true in general, we can take A 
in Equation (1) to be the unit matrix (since k does not depend on A) and 
use the fact that the determinant of the unit matrix is 1: then Equation 
(1) reduces to 


det (E) =k 
and combining this result with (1) we get 
det (AE) = det (A) x det (E). (2) 


From this equation we can deduce two important theorems. The second 
shows det to be a morphism with respect to multiplication of matrices in 
its domain and multiplication of real numbers in its codomain, and the 
first justifies the introduction of determinants at this stage: it gives us a 
theoretical criterion telling us when a matrix or endomorphism is singular. 
We shall use this theorem later in this unit to give a method for calculating 
the eigenvalues of small (2 x 2 or perhaps 3 x 3) matrices. (It is equivalent 
to Theorem 2.7 on page N91, but our proof is slightly different because we 
have defined the determinant function in a different way. It is also the same 
as Theorem III-8 on page K689, which has a completely different proof.) 


Theorem 1 
det A # 0 if and only if A is non-singular. 


Proof Notice the “if and only if ". There are two things to prove: 


(i) if A is non-singular, then det A #0; 
(i) if det A #0, then A is non-singular. 


(i) If A is non-singular, it can be written as a product of elementary 
matrices (see Theorem 6.1 on page N58), say A = E, +++ Ep, and Equation 
(2) gives 


det (E,E; ++» Ej) = det (E, +++ E,_,) det (Ej) 
= det (E, ++ E,..) det (E,..,) det (Ej) 
= det (Ej) det (E5) +++ det (Ej) (3) 


But we have seen that any elementary matrix can be obtained from the 
identity matrix by a column operation of Type I, II or III. The correspond- 
ing rules, as summarised on page 14, show that since det J = 1, the deter- 
minants of elementary matrices are never zero, and hence det A * 0. 

(ii) We now have to show that if det A #0, then 4 is non-singular. This 
is equivalent to the contrapositive proposition: 


if A is singular, then det A =0. 


(See Unit M100 17, Logic II: the contrapositive of a =b is ~ b= ~ a.) If 
A is singular, then its rank is less than #, the dimension of the domain 
vector space (see page N46, if necessary). Now the rank of A is equal to the 
maximum number of linearly independent columns (see page N41, if 


necessary), so when A is singular, the columns of A must be linearly de- 
pendent. But we have already seen (Theorem III-6, page K686) that in such 
a case det A = 0. This completes the proof of the theorem. 


Notice that an equivalent form of the statement of this theorem, as sug- 
gested in part (ii) above, is 


det A = 0 if and only if A is singular. 


Also notice that the first part of Theorem JII-8, page K689, is an equiva- 
lent result: we have set it as an exercise. 


The second theorem we shall deduce here is the multiplication rule for 
determinants, mentioned at the beginning of section 5.1.3. It is the same 
as Theorem 2.8, page N91, and the proof is the same too. In K it is Theorem 
III-10, page K698, with a different proof. 


"Theorem 2 
If A and B are n x n matrices, then 
det (AB) = det (BA) = det (A) det (B). 
Proof If A and B are non-singular, then each can be expressed as a pro- 


duct of elementary matrices, and the theorem follows by Equation (3) 
above; for example, if A = E,E; and B = E, E4, we have 


det (AB) = det (E,E; E, E4) = det (E,) det (E;) det (E3) det (E4) 
and 


det (A) det (B) = det (E, E;) det (E, E4) = above expression, 
etc. 


If either A or B is singular, then so are AB and BA (see, for example, 
Theorem 2.1 on page N41), and hence by the preceding theorem det (4B), 
det (BA) and det (A) det (B) are all zero. 

Exercises 


1. Is it true that the determinant function is a morphism with respect 
to the operations of matrix multiplication in its domain and ordinary 
multiplication in its codomain? 


2. Same as Exercise (1) but with “addition ” for ‘‘ multiplication”. 


3. [s it true that det (47!) = (det (A))~!-for all non-singular square 
matrices A? Note that the —1’s mean different things on the two sides 
of the equation. 


4. Same as Exercise (3) but with “ singular "for ** non-singular ”. 


5. Is it true that similar matrices always have the same determinant? 
(Similarity is defined on page N52.) 


6. Is it true that if ø is an endomorphism of a finite-dimensional vector 
space V, represented by matrices A and 4’ with respect to two differ- 
ent bases in V, then det (A) = det (4^7)? 


7. How would you define the determinant of an endomorphism c of a 
finite-dimensional vector space V? (Make sure your definition is 
basis-independent.) 


8. Prove the statement in the first sentence of Theorem III-8, page K689. 


Solutions 


l. Yes. This is just another way of stating our Theorem 2. 
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No. For example, 


o ob i-k t] 


1 0 0 0 10 
but, det n EE b P| +de F il: 


Yes. Theorem 2 gives 
det (A) det (A7!) = det (447!) = det 7 = 1. 


No. For a singular matrix, A, 4^! does not exist, and 
(det (4))^! is meaningless because det A = 0. 


Yes. A’ and A are similar if A' = P^!4P for some non- 
singular matrix P, and Theorem 2 gives det (P^! 4P) = 
det (P7!) det (A) det (P) = det (A), since det (P^!) det (P) = 
1, by Solution 3. 


Yes. If P is the matrix of transition from the basis for which 
the matrix representation of ø is A to the basis for which it is 
A’, then we have A’ = P^!AP by the rule given in the last 
paragraph on page N52. Hence, det (4^) = det (A) by Solu- 
tion 5. 


The determinant of ø can be defined as det A where A is the 
matrix representing o with respect to an arbitrary basis in V; 
this is basis-independent by Solution 6. 


We have to prove that “A necessary and sufficient condition 
(if and only if) that a set of n vectors a,,..., a, in 4" be 
linearly dependent is that D(a,,...,a,) = 0. 


(i) If the vectors are linearly dependent, Theorem III-6, 
page K686, proves that D(a,,...,a,) =0. 

(ii) If D(a,,...,a,)=0, that is det 4 —0, for the cor- 
responding matrix A, then our Theorem 1 states that A 
is singular; i.e. the rank of A is less than n. Thus the 
columns of 4 are linearly dependent. 


5.1.5 The Determinant of the Transpose 


In Exercises 4 (i) and (ii) of sub-section 5.1.3 we saw an example of a 
matrix with the same determinant as its transpose. As a third and final 
consequence of our result 


det (AE) = det (A) det (E) 
we can deduce that every matrix* has the same determinant as its transpose: 
det (4) = det (47) a) 
If A is singular, then so is its transpose (since row and column rank are 


equal), and so both sides of Equation (1) are 0. If A is non-singular, then 
it can be written as a product of elementary matrices 


A = EE" Ex 
so that 
A" = Ef © EVET, 


using the result that (4B)T = BTA" (see Exercise 4, page N57). Elementary 
matrices of Types I and IIl are equal to their transposes. Elementary 
matrices of Type II are upper or lower triangular and have determinant 1; 
their transposes also have determinant 1. Therefore we have 
det (A) = det (Ej) det (Ez) +- det (Ej) 

= det (ET) det (ET) «++ det (ET) 

= det (A7). 
This result has the corollary that row operations on a matrix affect the 


determinant in the same way as the corresponding column operations. In 
practice we mix row and column operations to suit our convenience. 


Exercises 


1. Fora general n x n matrix A, express det (— A) in terms of det (A). 


2. A square matrix is said to be skew-symmetric if 4 = — 47. What can 
be said about the determinant of skew-symmetric 7 x n matrices when 
n is odd? 

Solutions 


I. To convert A into —A, we need 7 column operations, each 
of which multiplies the determinant by -—1; therefore 
det (— 4) = (— 1)" det (A). For example, 


-1 0 0 1 0 0 10 0 
0-1 0/2--)0-1! 0|-2-4]|0 ! 0 
0 0-1 0 0-I 0 0-I 
100 
=-|0 1 0 
00 I 
2. det (A) = det (— 47) 
= det (— A) by Equation 1] above 
= (— l)" det (A) by Solution 1 
= —det (A) since n is odd. 


It follows that det (4) =0; i.e. any square skew-symmetric 
matrix of odd order is singular. (If the entries in the matrix 


* Remember that determinants are defined for square matrices only. 
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are drawn from fields other than R, this result may not hold. 
For example, {0, 1} with the usual arithmetic modulo 2 is a 
field for which 1 + 1 = 0. Hence, from 


det A + det A =0 


we cannot deduce that det A = 0.) 


5.1.6 Summary of Section 5.1 


Tn this section we defined the terms 


endomorphism (page C5) 
determinant function (page K680) 
determinant of a n x n matrix (page K681) 
permutation (page K683) 
column operations (page N57) 
Theorems 
1. (III-1, page K682) 
If one of the vectors a,,..., a, is the zero vector, then D(a,,..., 2,) 
=0. 
2. (III-2, page K682) 
If the sequence of vectors b,,...,b, is obtained from a,,..., a, by 
interchanging a; and a, (i #//) then 
D(bi, ..., b) = — Dla, ..., 8). 
3. (Corollary, page K682) 
If the sequence of vectors b,, ..., b, is obtained from a,,..., a, by 
shifting one of the a; k places to the left or right, then 
D(b,, ..., b) = (-*D(a,, ..., a). 
4. (III-3, page K684) 
For each a, there is one and only one function D satisfying Properties 
I through I1 of Definition III-1 (page K680). Its values are given by 
the formula 
D(a,,...,a) = ay; 9(p)asc)1p(22 ~ (ny + 
P 
5. (III-4, page K685) 
Let M = (a;j) be an n x n matrix and let M' = (b;j) be the transpose 
of M, i.e, the matrix whose columns are the rows of M (thus b;; = aj). 
Then 
det M = det M’. 
6. (III-5, page K686) " 
The value of a determinant is not changed by adding a multiple of the 
Jth column (row) to the ith column (row) if i # j. 
7. (III-6, page K686) 
If the vectors a,,..., a, are linearly dependent, then 
Ait +- 0, 
D(ay,...,a,) =|: : | =0. 
Ant +++ Qin 
8. (Theorem 1, page C18) 
det A # 0 if and only if A is non-singular. 
9. (Theorem 2, page C19) 
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If A and Baren xn matrices, then 


det (AB) = det (BA) = det (4) det (B). 


Techniques 


Evaluate the determinant of an n x n matrix by applying Rules I to IIT 
(page C14): 


I multiplying any column by a scalar multiplies the determinant by 
that scalar; 


II adding a multiple of any column to any other column leaves the 
determinant unaffected ; 


TII interchanging any two columns reverses the sign of the determinant, 


and by using the fact that the determinant of an upper or lower triangular 
matrix equals the product of the entries on its main diagonal. 


Notation 

D (page K680) 
det M (page K681) 
c (page K683) 
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5.2. EIGENVALUES 
5.2.1 Eigenvectors 


We have already seen, in the Introduction to this unit, informal definitions 
of the terms eigenvalue and eigenvector. If an endomorphism L leaves the 
direction of a vector x in its domain unchanged, then we call x an eigen- 
vector of L. In this case, L maps x to some scalar multiple of itself, say 2x, 
and the value of the multiplier is called the corresponding eigenvalue of L. 
The algebraic version of this statement is the starting point of the next 
reading passage. 


Example 


0 
fixed basis. Since 


b Jil- 


H is an eigenvector of ø and — 1 is the corresponding eigenvalue. You 


Let lo zil represent a linear transformation, c, with respect to some 


a]. " ; 
can check that, for any a, [2 is also an eigenvector corresponding to the 


eigenvalue — 1. 


Example 


If D denotes the differentiation operator in C(R), then 
(D? — 1) sin x = —2 sin x, 


so that x — sin x is an eigenvector of D^-— 1 with —2 as the 
corresponding eigenvalue. 


READ Section 12-2, page K461 as far as line 4 of page K462. 


Notes 


(i) line —14, page K461 In this unit we are looking at endomorphisms of vector 
Spaces; so we shall take it that 8 and Y^ are identical. The more general case 
considered in the book will not be required until Unit 25, Boundary-value 
Problems, in which the notion of eigenvalue is applied to differential equations. 
(i) line —13, page K461 “ unknown parameter which may take real or complex 
values.” All this means is that À is a scalar, and that we are interested in the 
solution sets of Equation (12-9) for various values of A. That is, we are interested 
in the sets (x: Lx — Ax) for various A. 

(iii) line — 11, page K461 “ non-trivial solutions ” means solutions other than the 
Zero vector. ` 

(iv) line —9, page K461 The remark about Euclidean spaces is not relevant to the 
present unit. 


Exercises 


1. In the vector space R?, which of the following vectors are eigenvectors 
of the endomorphism whose matrix representation with respect to the 


«afd i i : J 
standard basis is B 1 ? Where the given vector is an eigenvector, 
state also the corresponding eigenvalue. 


@ (LO, © @) © (LI, @ (-L-D, 
© a-), (0 (60. 
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2, 


If D denotes the differentiation operator with domain and codomain 
C?(R), which of the following are eigenvectors of the differential 
operator D + 1? State the corresponding eigenvalue, when there is one. 


3. If x is an eigenvector of an endomorphism L, with eigenvalue 2, and n 
is a positive integer, must it be true that x is an eigenvector of L"? 
If so, give the corresponding eigenvalue; if not, give a counter-example. 
Interpret your result geometrically. 

4. What relation exists between the solution set of Lx = Ax and the kernel 
of L — A, which is defined by (L — 4)x = Lx — 2x? 

Solutions 


l. (a)and (b) are not eigenvectors; 
(c) and (d) are eigenvectors, both with eigenvalue 2; 
(e) is an eigenvector, with eigenvalue 0; 
(f) is not an eigenvector (see line 1 of page K462). 


2. (a)is an eigenvector, with eigenvalue 2; 
(D + D)e* = 2e". 


(c) is an eigenvector, with eigenvalue 0; 
(b) and (d) are not eigenvectors. 


3. Yes, x is an eigenvector of L” with eigenvalue 4"; for example, 
L?x = L(Lx) = L(Ax) = AL(x) = 2x, 
L3x = L(L?x) = L(?x) = 172Lx = Xx, 


and so on. The geometrical interpretation is this: L multiplies 
x without affecting its direction, so if we perform Ln times we 
multiply x by 4" without changing its direction. 


4. The solution set of Lx =Ax and the kernel of L — 4 are 
identical; for the kernel of L — 4 is defined as 


{x: (L — 2x20) = (x: Lx — Ax = 0} 
= {x: Lx = x}, 


the solution set of Lx = Ax. 
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5.2.2 Eigenspaces and Invariant Subspaces 


We have seen (Solution 4,sub-section 5.2.1) that the solution set of Lx = 
Ax is the kernel of L — 2. We know that the kernel is a subspace (page 
N31), and so the solution set of Lx = Ax is a subspace. The next reading 
passage exploits this latter fact to characterize eigenvalues and eigenvectors 
in a simple way. 


READ from page K462, line 5, to the end of Example 3 on page K463. 


Notes 


(i) Lemma 12-1, page K462 We know already that the solution set of Lx = Ax 
is a subspace for any scalar A. The point of the lemma is that À is an eigenvalue if 
and only if this subspace is non-trivial (i.e. contains non-zero vectors). Sa is 
defined as the eigenspace of L corresponding to Ào. 

(ii) line 12, page K462 The zero vector is mentioned separately, because it is 
not allowed to be an eigenvector (line 1). 

(iii) line 14, page K462 The case dim S, = 0 is excluded since S, is required 
to be non-trivial. 

(iv) Definition 12-2, page K462 In other words ‘W is an invariant subspace if 
and only if L(A0) € W. 

(v) line —8, page K462 In other words, every eigenspace is an invariant sub- 
space, but not every invariant subspace is an eigenspace. For example, (0) is 
always an invariant subspace, but it is not an eigenspace. 

(vi) line —3, page K462 The word “one-dimensional” is redundant in this 
definition since a space spanned by a single non-zero vector must be one-dimen- 
sional. Geometrically, this definition tells us that L maps the line <x} to itself. If 
the eigenvalue is not 0, this mapping is onto; if it is 0, then <x) maps to the zero 
vector; but in either case <x) is invariant. 

(vii) Example 1, page K463 Reflection in Qe,» 


Invariant lines 


Axis of reflection 


(viii) Example 2, page K463 Reflection across the origin (equivalent to 180° 
rotation in the plane) 


€ 


Any line through the 
origin is invariant 
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(ix) Example 3, page K463 Rotation about the origin through an angle @ 


Exercise 


no invariant lines 


For a rotation about an axis through the origin in three-dimensional space, 
describe geometrically 


(i) the invariant subspaces (and give their dimensions); 
(ii) the eigenspaces (and give the corresponding eigenvalues). 


Solution 


(i) 


a 


Assuming that the rotation is a multiple of z, the invariant 
subspaces are: 


(a) the origin (dimension 0); 

(b) the axis of rotation (dimension 1); 

(c) the plane of rotation through the origin perpendicular 
to the axis of rotation (dimension 2); 

(d) the entire space (dimension 3). 


Tn addition, if the rotation is an odd multiple of z, then any 
line lying in the plane of rotation through the origin is an 
invariant subspace (dimension 1), as is any plane containing 
the axis of rotation (dimension 2). 


If the rotation is an even multiple of x, then it is the identity 
and every subspace is invariant. 


If the rotation is not a multiple of z, the only eigenspace is 
the axis of rotation, and its eigenvalue is 1. But if the rotation 
is an odd multiple of z, then also, as in Example 2, page 
K463, the plane of rotation through the origin is an eigen- 
space with eigenvalue — 1. 


If the rotation is an even multiple of z, then the eigenvalue 
is 1 and the eigenspace is the whole space. 
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5.2.3 Linear Independence of Eigenvectors 


One of the main objects of studying eigenvectors of an endomorphism is 
that they can be used in constructing a basis which is particularly well 
adapted to that particular endomorphism. Since the one-dimensional 
invariant spaces give a set of “ directions”, it is natural to use these as far 
as possible as "axes" in setting up a coordinate system—or, in other 
words, to use the eigenvectors as at least some of the basis vectors. The 
first step in setting up such a basis is to make sure that the eigenvectors are 
linearly independent. The next reading passage gives a theorem that helps. 


READ page K463 from “All this is simple enough ..." to the end of the 
section on page K464. 


Note 


line —5, page K463 The method of proof by induction was discussed in Unit 
M100 17, Logic II. 


Example 


0 -l 1 
corresponding to —1 and M corresponding to +1. Theorem 12-1 claims 


Two eigenvectors of a transformation represented by k zil are H 


that these eigenvectors are linearly independent, as you can easily check. 


Example 


Notice that Theorem 12-1 says nothing about eigenvectors corresponding 
to the same eigenvalue. These may or may not be linearly independent. 
Thus both 


X —— six (x e R) 
and 
X — —À cos X (xe R) 


are eigenvectors of the linear differentiation operator D? — 1, correspond- 
ing to an eigenvalue —2. They are, however, linearly independent. (See 
also Exercise 2, below.) 


Exercises 


1. What is the largest possible number of distinct eigenvalues for an 
endomorphism of an n-dimensional vector space? 


2. In Theorem 12-1 on page K463, the eigenvalues are required to be 
distinct. Give a counter-example showing that the theorem would be 
false if the word “distinct ” were omitted. 


Solutions 


1. Choose one cigenvector for each distinct eigenvalue. These 
eigenvectors are lincarly independent; but the largest possible 
number of vectors in a linearly independent set is equal to the 
dimension of the space. So we can have at most » distinct 
eigenvalues. 

2. Here are two possibilities: 


(a) Let x be an eigenvector of L and let y be a non-zero scalar 
multiple of x: then x and y are eigenvectors of L, but are 
not linearly independent; 

(b) let L be the identity transformation in a vector space V; 
then any non-zero vector in V is an eigenvector of L, and 
any set of non-zero vectors in V is a set of eigenvectors 
of L, but that set is not necessarily linearly independent. 
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5.2.4 Eigenvector Bases 


The theorem in the preceding sub-section gives a partial answer to the ques- 
tion: when can we form a basis consisting entirely of eigenvectors? If the 
vector space is n-dimensional, and the transformation has n different 
eigenvalues, then any set of corresponding eigenvectors, being linearly 
independent, constitutes a basis. The next reading passage gives the matrix 
representation of the endomorphism in such a basis, and gives an example 
of how it can be used for calculations. 


READ Section 12-3 page K465 to “... has been left to the reader.” in the 
middle of page K466. 


Notes 


G) Diagonal matrix, page K465 If the basis is aı, az, ..., an and a, is an 
eigenvector with eigenvalue A,, we have 


Ài 
La, = à,a,, so that the first column is 


0 
Aa 
La, = Az a2, so that the second columnis |. 0 


0 

and so on. Remember that the coordinates of the image vectors of the basis are 
the columns of the matrix representation of L with respect to that basis. 

(ii) Theorem 12-2, page K465 The condition that all eigenvalues be distinct is 
sufficient, but not necessary, for an eigenvector basis to exist. That is, an eigen- 
vector basis can exist even when the number of distinct eigenvalues is less than 
n. For example, the identity transformation in Ù has the single eigenvalue 1, so 
that the theorem does not apply (unless n = 1). Since every non-zero vector 


is an eigenvector of the identity transformation, any basis of Ù is an eigenvector 
basis, and the identity transformation always has the same matrix representation 


E 1 0 


(iii) Example 1, page K465. Despite this example, the method is rarely used for 
linear problems in finite-dimensional spaces, because the methods based on row 
operations of matrices (see Unit 3, Hermite Normal Form) are more effective. 
For infinite-dimensional spaces, however, the method described in this example 
is often the only way to solve the problem. 

(iv) lines 9-14, page K466 The case where the A, are all different from zero is 
the case where L is non-singular (see the second sentence on page K462). When 
L is singular, a solution is possible only if y lies in the image space of L, which is 
<e2, e3» in the case considered here with only A, = 0 (since 


L(xiei + X2 €z + X3 63) = X2 Az ei X3 Às Cs € Cez, 03) 
If y does lie in the image space, the general solution has the form: 
(kernel) + particular solution. 


In K's solution the term xe, is a general element of the kernel ¢e,>, and the 
other two terms are a particular solution of Lx — y. 


Exercises 


]. Under the conditions of Theorem 12-2, what is the matrix represent- 
ing L? with respect to the eigenvector basis? If L is non-singular, what 
is the matrix representing L~', and how is it related to Example 1, 
page K465? 
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2. 


We saw, in Exercise | of sub-section 5.2.1, that the endomorphism L of 
R? whose matrix representation with respect to the standard basis is 
A= fi 1 has eigenvectors (1, 1) and (1, — 1) corresponding to the 
eigenvalues 2 and 0 respectively. Write down the matrix of transition 
for changing to a basis consisting of these eigenvectors of L. Check 
your result! 


Show that if L has matrix representation A with respect to some basis, 
and the space has a basis of eigenvectors, then det A is equal to the 
product of its eigenvalues. Interpret this result geometrically. 


Solutions 
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1. Z? is represented by [ 42 0 
A 
0 (AR 
L^! is represented by [ 1/4, 0 
1/4; 


0 MA, 
In Example 1, the solution to Lx = y is x = L^ ty. 
2. By formula (4.1) on page N50, the matrix of transition has 


columns giving the old coordinates of the new basis vectors; 
in the present case this matrix is 


1 1 11 
ne [i aee E i} 
The formula for this change of basis is (see page N52, if 
necessary) 
A’ = PAP, 
To evaluate it, we use 


1 fi 1 2 0 
ar=|i il EILIF el 
= 4 El 
and P7! = k |: 
i -i 
Thus, the matrix in the new (eigenvector) basis is 


coral AJ 


[2 0 
(0 0 
which is in the form predicted by Theorem 12-2. 


3. If B is the matrix representation of L with respect to the basis 
of eigenvectors, then 


det B = det A 


since the value of the determinant of a linear transformation is 
basis-independent (Solution 6, sub-section 5.1.4). The matrix B 
is diagonal and its entries are the eigenvalues; hence, det B equals 
the product of the eigenvalues, since B is diagonal (a special case 
of triangular). 


The geometrical interpretation is this: the effect of L on an n-di- 
mensional “parallelogram” with edges parallel to the n eigen- 
vectors is to stretch the first edge by a factor 4,, the second bya 


factor 4; , and so on, so that the volume of the “ parallelogram” 


is multiplied by the product of these linear factors. 


5.2.5 Summary of Section 5.2 


In this section we defined the terms 


non-trivial (page C24) Xx 
eigenvector (page K461) WE 
eigenvalue (page K461) Ec 
eigenspace (page C26) t 
invariant under L (page K462) te 
diagonal form of a matrix (page K465) t% 


Theorems 
I. (Lemma 12-1, page K462) 
The solution set of the equation Lx = J, x is a nontrivial subspace of S t+ 


for each eigenvalue 4 of L . (L : 8 —— V) 


2. (12-1, page K463) 
Any set of eigenvectors belonging to distinct eigenvalues for a linear oe 
transformation L : $ ——> *U is linearly independent in $. 


3. (12-2, page K465) 
A linear transformation L mapping an n-dimensional vector space U xc 
into itself has at most n distinct eigenvalues. Moreover, when the num- 
ber of distinct eigenvalues is equal to n, any complete set of eigenvectors, 
one for each eigenvalue, is a basis for U, and the matrix of L with 
respect to such a basis is 


à 
A, 0 


0 À, 


with the eigenvalues on the main diagonal and zeros elsewhere. 


In the first and second theorems, we are interested in endomorphisms, 
ie. L: 8 —— 8 


Notation 
Sa (page K462) 
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+ +++ 


5.3 SOME CALCULATIONS WITH EIGENVALUES 
5.3.1 The Characteristic Polynomial 


This section brings together the work in the first two sections. We shall use 
the determinant function to calculate eigenvalues. 


READ from “ The technique introduced in the above...” on page K466 to 
the end of page K469. 


Notes 


(i) line 4, page K467 “as we have already observed." This was in a section 
we have not asked you to read (page K459); but essentially the same observation 
was made in Solution 4 of sub-section 5.2.1. 

(i) line 8, page K467 Remember that J is represented by 


b 


(iii) Equation (12-14), page K467 Another way of stating the argument is this: 
the scalar À is an eigenvalue of L if and only if the linear transformation L — À 
is singular, and L — A is singular if and only if its determinant is zero. Equation 
(12-14) is just the expression for the determinant of L — A. 

(iv) line —7, page K467 The result that the determinant is a polynomial of degree 
n depends on Theorem III-3, page K684: there is just one product of the form 
(ası —A)(@22 — A) +++ (a4, — A) among the n! products to be summed. The fact 
that the degree of the polynomial is » is very important in practice. It means that 
this method will work very well if n — 2, Since then the characteristic equation 
(12-14) is a quadratic; but for n > 3, the equation is at best a cubic and would 
normally have to be solved numerically. In fact, determinants larger than 3 x 3 
are not usually suitable for numerical work, and so the eigenvalues of transforma- 
tions represented by large matrices have to be found by other methods. We shall 
be looking at some of these methods later in the course. 

(V) bottom line, page K468 This example has been contrived so that the 
charácteristic equation can be solved easily, even though it is a cubic. One way of 
evaluating the determinant is this: 


-À 0 1 0 0 1 
0 =+) o |= 0 -ü-3 0 
2 2 1—A 2+A-2» 2 1—A 
col. 1 +A x col. 3 
1 0 0 
=-| 0 -+A 0 
1—A 2 2+- 
interchange cols, 1 and 3 
= 4424-29), 


This is 0 if à+ 1 =0, or 2+A—A2 =0; that is, if à = —1, or if À = —1 or 2, 
The eigenvalues are —1 and 2. 

(vi) line 7, page K469 A systematic way of dealing with such systems of equa- 
tions is to use Hermite normal form. The matrix equation is equivalent to 


—2 0 IT[x: 0 
0 —3 0j |x| 10]. 
2 2 =l] Lx, 0. 


Putting the matrix into Hermite normal form, gives 


10 =} fx: 0 

0 1 0||x;| =]0 

00 Oll» 0. 
which tells us that 


Xi = 4X3 
X2=0, 


The solution set therefore comprises all vectors of the form (4x3, 0, x3), with 
arbitrary x3; i.e, it is (je, 4- e3), Or Ce, + 2es) as stated in K. 
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(vii) : line —3, page K469 Complex solutions of this characteristic equation are 
not eigenvalues, since an eigenvalue is (by definition) a scalar and we are working 
with a real vector space. 


Exercise 


Find the eigenvalues and eigenspaces of the linear transformation in R? 
whose representation, with respect to the standard basis, is 


(a) [2 1 (b) [11 
0 3 1 of 
If you need extra practice, try Exercise 1 on page K470. 


Solutions 


(a) The characteristic polynomial is 


2-4 1 
0 3-4 


20-20-24). 


The characteristic equation is (A — 3)(A — 2) = 0, whose roots 
are 3 and 2. The eigenvectors corresponding to A = 3 are the 
solutions of 


which can be written 
—-1 I][x]. [0 
0 O}lx.| oi 
So x, = x,, and the eigenvectors are 
1 
xij 
and the eigenspace is ( H ) 


The eigenvectors corresponding to A = 2 are the solutions of 


b ill) - lol 


So x, = 0, and the eigenvectors are 


l 
xilo 
and the eigenspace is NH ) 


(b) The characteristic polynomial is 


1-4 l| a 
1 T A -àÀ-l. 
The characteristic equation is 22 — 4 — | =0. Its solutions, 
the eigenvalues, are 
1+ 5 
A= lm 1.618 
—. f$ 
and 4, = 1-5 2 _osig, 


Rather than carry around ugly expressions, we will use the 
symbols 4,, 4; respectively. 
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The eigenvectors (x,, x2) corresponding to the eigenvalue 2, 
are given by 


[s] 
[2^ A18]-B] 


If we multiply the first row by 4, and add the result to the 
second row, we get 


1—4, 1][x,] _ [0 
1+4,-A} O} |x| LO] 
But 4, satisfies the characteristic equation, so that 
A? —2,-1=0, ie. 


[s^ JE] be 


am X2 
Ap e 

But 42 — 4, -1=0 
ie. A4 — 1) = 1. 


Thus 


So x; = Ax; 
The eigenvectors are (Ax, x2) and the eigenspace is 
(e, + ez). 


Similarly the eigenspace corresponding to 4; is (45e; + e2). 


5.3.2 An Application of Eigenvectors 


One of the useful properties of an eigenvector basis is that not only the 
transformation itself but also its powers have a very simple matrix repre- 
sentation with respect to this basis. As an illustration of how this fact can 


be used, we apply it to get a formula for the general element of the Fibonacci 
sequence 


1,1,2,3,5,8, ..., Fey ... 


The defining rule of this sequence is that each element is the sum of its two 
immediate predecessors, and the first two terms are both 1: 


ie. Fpi =F, + Fy, (k =2,3,...). 


The recurrence formula is equivalent to 


i] sl.) 


In other words, we are saying that this recurrence formula can be expressed 
in terms of a linear transformation L in R? 


Fev E) = LF, Fi) (1) 
where the matrix representation of L is 
[i o 
1 0 
with respect to the standard basis. 
By repeated application of Equation (1) we get 
(F3, F2) = L(F4, F) = L0, 1) 
(Fa, F3) = L(F,, F7) = L?(F;, Fi) = E90, 1) 
(Fs Fy) = LF, Fs) = Di; 1) 
and in general 
iro F) = L7, 1). 


To calculate L*~*(1, 1) we express (1, 1) in terms of a basis consisting of 
eigenvectors of L. The solution to the last exercise showed that two eigen- 
vectors are 


a, =(A,,1) and a= (43, 1) 
. + where Ay = 4(1 + 4/5) = 1.618 
and 4; = 4(1— J5) œ —0.618. In terms of these, the vector (1, 1) is given 
by 
(1, 1) = a, (å, 1) + (4, 1) 


where a, and à; are numbers which can be found by solving the simultane- 
ous equations 


(1, 1) = (8,4; + 82 42, 0, + 05) 


ie. 
014; - 4545 = 1 
a +a,=1 
Az l-4 
so that a, ar =a anda; L-A 


The effect of L, or any power of L, on (1, 1) is easily calculated, and so we 
have 


L(L, 1) = eL, 1) + e L5, 1) 
= 0644,04, 1) + 24505, D 
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and similarly 

LETECI, 1) =a, AE (4, 1) + a, 457 (45 , 1). 
Thus, 

(Fav F) 204710, D + 234571 (5,1) 
that is, F,, the kth Fibonacci number, is given by 


F,- aM! casa 


A test of this formula is given in the following table: 
k | eM | oM | F 
1| 0.7236 0.2764 | 1 
2 1.1708 | —0.1708 1 
3 1.8944 0.1056 | 2 
4| 3.0652 | —0.0652] 3 
5| 4.9597 0.0403 | 5 
6 | 8.0249 | —0.0249 | 8 
7 | 12.9846 0.0154 | 13 
8 | 21.0095 ! —0.0095 | 21 
9 | 33.9941 0.0059 | 34 
10 | 55.0037 | —0.0036 | 55 


One of the remarkable features of this formula is that for large k the first 
term alone gives a good approximation. This is a general feature of cal- 


culations involving high powers of matrices [ here, high powers of li al): 


As the power increases, the behaviour is dominated by the largest eigenvalue. 
This fact is the basis of the simplest practical method of numerically cal- 
culating eigenvalues and eigenvectors for matrices larger than 2 x 2. We 
shall be studying this method in Unit 30, Numerical Solution of Eigenvalue 
Problems. 


Exercise 
A method of approximating to J2, known to the ancient Greeks, is to use 
the sequence of fractions 
137 a, 
1 , 2 > 5 $ vag B, 
Op, = Oy + Pa E 
Bros = ty + By J = Hd) 
Obtain explicit formulas for «, and fl, and hence show that 


lim (s) =/2. 


n large 


; in which 


Solution 


In matrix form the recurrence relation is 
Wl- ls 
Bas 1 118, 


(ntis Bei) = Llan, B,)- 
The characteristic equation is 


1-4 2 
1 1-4 


or (1 — 4)? — 2 = 0, ie. 4? —24—1—0. 


or 


=0 
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Its solutions are 4, and 4; , where 
A -21-2 
A 21-42 


The corresponding eigenvectors are obtained by solving 
-J2 2 [ed _ fo 
1. -J2]i] (ol 
2 24/61 0 
1 y2 " of’ 


(V2, 1) and (-Y2, 1) are eigenvectors corresponding to the eigen- 
values A, and A, respectively. 


and 


In terms of these as basis, the vector («,, f,) = (1, 1) is 


0, D —».(2,1) + (7/2, 1) 
where J2n - J/2n =1 
and y, + y.=1 


ie. yy = (V2 + 1)/0./2) and y, = (V2 — 1/042). 


Then we have 


ns Ba) 710,1) = v 1 (/2, 1) + 2 2271 (74/2,1) 


Oy = nar /2 — V2 a2 
Ba = nA ESAE. 


ie. 


b æ, 
To calculate lim —, we use the above forms. 


n large Bn 
Hence 
an pA IVZ- a2 
B, REEL 


Now divide numerator and denominator by y;41^ ! (A1, remember, 
is greater than 4;) 

[^ J2 = Garay 1/2 

B, 1+ Qa r03/2* 


D 1 = Gar )A2/4 Y! 
E Vi; + a) i 


Since 0 < 


2) <1, lim 2 = /2. 
1 


n large Bn 


5.3.3 Summary of Section 5.3 


In this section we defined the terms 


characteristic polynomial (page K467) 
characteristic equation (page K467) 


Technique 


Use the characteristic equation of a small n x n matrix to determine the 
eigenvalues and the corresponding eigenvectors of the transformation re- 


presented by the matrix. 


* *o* 


5.4 SUMMARY OF THE UNIT 


Definitions 


The terms defined in this unit and page references to their definitions are 
given below. 


endomorphism (page C5) 
determinant function (page K680) 
determinant ofa n x n matrix (page K681) 
permutation (page K683) 
column operations (page N57) 
non-trivial (page C24) 
eigenvector (page K461) 
eigenvalue (page K461) 
eigenspace (page C26) 
invariant under L (page K462) 
diagonal form of a matrix (page K465) 
characteristic polynomial (page K467) 
characteristic equation (page K467) 
Theorems 


We list the important theorems discussed in this unit. Only 3 star 
theorems which are essential to this and later units have been included in 
this list. References to the statements of the theorems are also given. 


l. (HI-1, page K682) 
If one of the vectors a,, ..., a, is the zero vector, then D(a,, ..., aj) 
=0. 


2. (1-2, page K682) 
If the sequence of vectors b,, ~+.» b, is obtained from a,,..., a, by 
interchanging a; and aj( + j) then 


D(bi, ..., b) = — D(a,,..., ap). 
3. (II4, page K685) 
Let M = (aj) be an n x n matrix and let M' = (bj) be the transpose 


of M, i.e., the matrix whose columns are the rows of M(thus 5;; = aj). 
Then 


det M = det M". 
4. (III-5, page K686) 


The value of a determinant is not changed by adding a multiple of the 
jth column (row) to the ith column (row) if i sj. 


5. (III-6, page K686) 


If the vectors a,, ..., a, are linearly dependent, then 
Qj s Ain 
Dlan... a=] : : =0, 
Ani vs Any 


6. (Theorem 1, page C18) 
det A #0 if and only if A is non-singular. 


7. (Theorem 2, page C19) 
If A and Baren x n matrices, then 


det (4B) — det (BA) — det (A) det (B). 
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8. (Lemma 12-1, page K462) 
The solution set of the equation Lx = Ay x is a nontrivial subspace of 
8 for each eigenvalue Ag of L(L: $ ——— V). 
9. (12-1, page K463) 
Any set of eigenvectors belonging to distinct eigenvalues for a linear 
transformation L : § ——> *U is linearly independent in 8. 
10. (42-2, page K465) 
A linear transformation L mapping an n-dimensional vector space U 
into itself has at most n distinct eigenvalues. Moreover, when the 
number of distinct eigenvalues is equal to n, any complete set of eigen- 
vectors, one for each eigenvalue, is a basis for W, and the matrix of 
L with respect to such a basis is 
Ay 
Ay 0 
5 > 
A, 
with the eigenvalues on the main diagonal and zeros elsewhere. 
Techniques 
1. Evaluate the determinant of an n x n matrix by applying Rules I to III 
(page C14): 
I multiplying any column by a scalar multiplies the determinant by 
that scalar; 
IL adding a multiple of any column to any other column leaves the 
determinant unaffected ; 
III interchanging any two columns reverses the sign of the deter- 
minant, 
and by using the fact that the determinant of an upper or lower tri- 
angular matrix equals the product of the entries on its main diagonal. 
2. Use the characteristic equation of a small n x n matrix to determine the 
eigenvalues and the corresponding eigenvectors of the transformation 
represented by the matrix. 
Notation 
D (page K680) 
det M (page K681) 
c (page K683) 
8, (page K462) 
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5.5 SELF-ASSESSMENT 


Self-assessment Test 


This Self-assessment Test is designed to help you test quickly your under- 
standing of the unit. It can also be used, together with the summary of the 
unit for revision. The answers to these questions will be found on the next 


non-facing page. We suggest you complete the whole test before looking 
at the answers. 


1. By considering column and row operations, say how the determinants 


of the following matrices are related: 


1 2 3 -2 -1 3 
A=|-1 -2 3| B=] 2 13 
0 03 0 03 


"JW a 
c={ 1 2- 
0 0 3 


2. Evaluate the determinants of the following matrices: 


[0] 21 5] à) 411 
4A-|0 1 3 B=|-1 4 3 
bi EEE 


Gii) 0100 
1000 
P-looo! 
0010 


3. Find the eigenvalues and eigenspaces of the endomorphisms of R? 
represented by the following matrices: 


^ra 9g "Ej 


4. Determine the characteristic polynomial of the following matrix: 


010 
001 
34 5 


Exercise 4, page K464. 
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Solutions to Self-assessment Test 


1, 
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The row operation 
add row 1 to row 2 


applied to each of A, B and C yields an upper triangular matrix in 
each case. A zero element occurs in each main diagonal. Therefore 


det A = det B= det C = 0. 
(i) This is upper triangular in form. Hence 
det422x1x(-3)2 —6. 


(i) Subtract 2 x row 3 from row 1, giving 


0 0 0 
det B=|—1 4 3| 20. 
244 
Gii) interchange col. 1 and col. 2, and interchange col. 3 and col. 4. 
Hence 
1000 
0100 
det D= 0010 =1. 
0001 
(i) The characteristic equation is 
4-2 0 
$ stad | = 
where 4 is real. 
So (4 — AY +A) — 0, 
Hence A = 4 and 4 = — 1 are the eigenvalues. Corresponding to 


A = 4, the eigenvectors [2] are given by 
2 
4 MEETS 
$ -i| 5] g 45] 
0  O][x] [oO 
2 -5]ix;] 0I 


* 5 
Hence 2x, = 5x,, and the eigenvectors have the form x; [i] 


ie. 


where x; is arbitrary. 


The eigenspace is n H ) 


Corresponding to 4 = — 1, the eigenvectors are given by 


HEIDE 


Hence x, — 0 and x; is arbitrary. 


The eigenspace is ( [i] ) 


(i) The characteristic equation is 


-A 1 


2 aa 


ie. A? = 2, 


SoA=./2anda= -./2. 


Corresponding to 4 = V 2, the eigenvectors are given by 
[7 -kll 
2. =/2| [x2 0| 
Hence x; = J2 2x, 
and J2x, = 2x,. 
Thus x,= J 2x1. 


; 1 
The eigenvectors have the form x, Al , where x, is arbitrary and 


l 
the eigenspace is (Lal » 
2 


Corresponding to À = —./2, by similar reasoning to that for 


A= 2, the eigenspace is (| ‘Al ) 


(iii) The characteristic equation is 


D 1 

| $ dea" 
ie. (1-273) 7220 
or P-3-0 


Hence A = 0 and 4 = 3. 


Corresponding to A = 0, the eigenvectors are given by 


EE 


i.e. x, +x, =0. 


Thus, the eigenspace is ( [_ il ) 


Corresponding to 4 = 3, the eigenvectors are given by 


-2 I][x;] _ [0 
2 -1A|ix LO} 
ie. -2x, + x, =0. 


Thus, the eigenspace is ( [a] ) 


4. (i) The characteristic polynomial is 


-A 1 0 EZ! 1 0 
0 -A 1 {=} 0 0 1 
3 4 5-4 3 4451-23 5-2 
(add A x col. 3 to col. 2) 
0 1 0 
= 0 0 1 


34444+5-2 4451-2? 5-1 
(add A x col. 2 to col. 1) 


43 


5. (a) 


(b) 


1 0 0 
= (-1} 0 1 0 
4454-2 5-4 34424 522 22 


(two column interchanges) 
=3 + 44 + 54%? — 4°. 


Let.x be any element of the kernel (null space) of L. Then, by 
definition of x 


Lx=0. 
Hence L(kernel of L) € kernel of L. 


So, by Definition 12-2 (page 462), the kernel is invariant. 
Let x be any element of L(V); i.e. x = Ly, for some ye U. 


Then L(x) = L(Ly) = L?y 
= Ly, since L? = L, 
= x, by definition of y. 
Hence Lx € L(V), and L(V) is invariant by Definition 12-2. 


LINEAR MATHEMATICS 


WAIADNAWNH 


Vector Spaces 

Linear Transformations 

Hermite Normal Form 

Differential Equations I 

Determinants and Eigenvalues 

NO TEXT 

Introduction to Numerical Mathematics: Recurrence Relations 
Numerical Solution of Simultaneous Algebraic Equations 
Differential Equations II: Homogeneous Equations 
Jordan Normal Form 

Differential Equations III: Nonhomogeneous Equations 
Linear Functionals and Duality 

Systems of Differential Equations 

Bilinear and Quadratic Forms 

Affine Geometry and Convex Cones 

Euclidean Spaces I: Inner Products 

NO TEXT 

Linear Programming 

Least-squares Approximation 

Euclidean Spaces II: Convergence and Bases 
Numerical Solution of Differential Equations 

Fourier Series 

The Wave Equation 

Orthogonal and Symmetric Transformations 
Boundary-value Problems 

NO TEXT 

Chebyshev Approximation 

Theory of Games 

Laplace Transforms 

Numerical Solution of Eigenvalue Problems 

Fourier Transforms 

The Heat Conduction Equation 

Existence and Uniqueness Theorem for Differential Equations 
NO TEXT 


45 


LM 5 


335 01094 6 


